Bayesian Estimation of Kernel Bandwidth for Nonparametric Modelling
نویسندگان
چکیده
Kernel density estimation (KDE) has been used in many computational intelligence and computer vision applications. In this paper we propose a Bayesian estimation method for finding the bandwidth in KDE applications. A Gamma density function is fitted to distributions of variances of K-nearest neighbours data populations while uniform distribution priors are assumed for K. A maximum log-likelihood approach is used to estimate the parameters of the Gamma distribution when fitted to the local data variance. The proposed methodology is applied in three different KDE approaches: kernel sum, mean shift and quantum clustering. The third method relies on the Schrödinger partial differential equation and uses the analogy between the potential function that manifests around particles, as defined in quantum physics, and the probability density function corresponding to data. The proposed algorithm is applied to artificial data and to segment terrain images.
منابع مشابه
Bayesian bandwidth estimation for a nonparametric functional regression model with unknown error density
Error density estimation in a nonparametric functional regression model with functional predictor and scalar response is considered. The unknown error density is approximated by a mixture of Gaussian densities with means being the individual residuals, and variance as a constant parameter. This proposed mixture error density has a form of a kernel density estimator of residuals, where the regre...
متن کاملBayesian Approaches to Non-parametric Estimation of Densities on the Unit Interval
This paper investigates nonparametric estimation of density on [0,1]. The kernel estimator of density on [0,1] has been found to be sensitive to both bandwidth and kernel. This paper proposes a unified Bayesian framework for choosing both the bandwidth and kernel function. In a simulation study, the Bayesian bandwidth estimator performed better than others, and kernel estimators were sensitive ...
متن کاملBayesian Bandwidth Selection for a Nonparametric Regression Model with Mixed Types of Regressors
This paper develops a sampling algorithm for bandwidth estimation in a nonparametric regression model with continuous and discrete regressors under an unknown error density. The error density is approximated by the kernel density estimator of the unobserved errors, while the regression function is estimated using the Nadaraya-Watson estimator admitting continuous and discrete regressors. We der...
متن کاملTHE COMPARISON OF TWO METHOD NONPARAMETRIC APPROACH ON SMALL AREA ESTIMATION (CASE: APPROACH WITH KERNEL METHODS AND LOCAL POLYNOMIAL REGRESSION)
Small Area estimation is a technique used to estimate parameters of subpopulations with small sample sizes. Small area estimation is needed in obtaining information on a small area, such as sub-district or village. Generally, in some cases, small area estimation uses parametric modeling. But in fact, a lot of models have no linear relationship between the small area average and the covariat...
متن کاملNonparametric Bayesian Kernel Models
Kernel models for classification and regression have emerged as widely applied tools in statistics and machine learning. We discuss a Bayesian framework and theory for kernel methods, providing a new rationalization of kernel regression based on nonparametric Bayesian models. Functional analytic results ensure that such a nonparametric prior specification induces a class of functions that span ...
متن کامل